BioNLP'09 Shared Task on
Event Extraction
in conjunction with BioNLP, a NAACL-HLT 2009 workshop, June 4-5 2009, Boulder, Colorado
[Shared Task Home] [Evaluation Methods] [Master Result Table] [Team Profiles] [System Profiles]

Final Evaluation Results
on REG-TOTAL events by Approx. Span matching

Task 1

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[ UTurku  ]       ==[REG-TOTAL]==       1653 (  582)     1282 (  582)    35.21    45.40    39.66
[ConcordU ]       ==[REG-TOTAL]==       1653 (  447)      910 (  447)    27.04    49.12    34.88
[JULIELab ]       ==[REG-TOTAL]==       1653 (  576)     1694 (  576)    34.85    34.00    34.42
[UT+DBCLS ]       ==[REG-TOTAL]==       1653 (  429)     1038 (  429)    25.95    41.33    31.88
[VIBGhent ]       ==[REG-TOTAL]==       1653 (  286)      908 (  286)    17.30    31.50    22.34
[  UNSW   ]       ==[REG-TOTAL]==       1653 (  274)      962 (  272)    16.58    28.27    20.90
[ UTokyo  ]       ==[REG-TOTAL]==       1653 (  233)      686 (  233)    14.10    33.97    19.92
[ UZurich ]       ==[REG-TOTAL]==       1653 (  238)      811 (  238)    14.40    29.35    19.32
[UAntwerp ]       ==[REG-TOTAL]==       1653 (  181)      613 (  181)    10.95    29.53    15.98
[   Cam   ]       ==[REG-TOTAL]==       1653 (  165)      437 (  165)     9.98    37.76    15.79
[  SCAI   ]       ==[REG-TOTAL]==       1653 (  209)     1263 (  209)    12.64    16.55    14.33
[ Team 24 ]       ==[REG-TOTAL]==       1653 (  154)      801 (  153)     9.32    19.10    12.52
[  NICTA  ]       ==[REG-TOTAL]==       1653 (  129)      712 (  129)     7.80    18.12    10.91
[ UAveiro ]       ==[REG-TOTAL]==       1653 (  104)      494 (  104)     6.29    21.05     9.69
[CIPS-ASU ]       ==[REG-TOTAL]==       1653 (  196)     2404 (  196)    11.86     8.15     9.66
[CNBMadrid]       ==[REG-TOTAL]==       1653 (  194)     2527 (  194)    11.74     7.68     9.28
[ASU+HU+BU]       ==[REG-TOTAL]==       1653 (   86)      257 (   86)     5.20    33.46     9.01
[  UMich  ]       ==[REG-TOTAL]==       1653 (  233)     3582 (  233)    14.10     6.50     8.90
[ USzeged ]       ==[REG-TOTAL]==       1653 (   69)      379 (   69)     4.17    18.21     6.79
[ UNIMAN  ]       ==[REG-TOTAL]==       1653 (   67)      400 (   67)     4.05    16.75     6.53
[CCP-BTMG ]       ==[REG-TOTAL]==       1653 (   51)      106 (   51)     3.09    48.11     5.80
[ Team 09 ]       ==[REG-TOTAL]==       1653 (   40)      336 (   40)     2.42    11.90     4.02
[  PIKB   ]       ==[REG-TOTAL]==       1653 (   18)       59 (   18)     1.09    30.51     2.10
[ KoreaU  ]       ==[REG-TOTAL]==       1653 (   11)       29 (   11)     0.67    37.93     1.31

Task 2

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ]       ==[REG-TOTAL]==       1658 (  418)     1038 (  418)    25.21    40.27    31.01
[UAntwerp ]       ==[REG-TOTAL]==       1658 (  172)      613 (  172)    10.37    28.06    15.15
[ Team 24 ]       ==[REG-TOTAL]==       1658 (  154)      818 (  153)     9.29    18.70    12.41
[ASU+HU+BU]       ==[REG-TOTAL]==       1658 (   81)      257 (   81)     4.89    31.52     8.46
[CNBMadrid]       ==[REG-TOTAL]==       1658 (  148)     2527 (  148)     8.93     5.86     7.07
[CCP-BTMG ]       ==[REG-TOTAL]==       1658 (   50)      106 (   50)     3.02    47.17     5.67

Task 3

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------